\(
\newcommand{\water}{{\rm H_{2}O}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\N}{\mathbb{N}}
\newcommand{\Z}{\mathbb{Z}}
\newcommand{\Q}{\mathbb{Q}}
\newcommand{\E}{\mathbb{E}}
\newcommand{\d}{\mathop{}\!\mathrm{d}}
\newcommand{\grad}{\nabla}
\newcommand{\T}{^\text{T}}
\newcommand{\mathbbone}{\unicode{x1D7D9}}
\renewcommand{\:}{\enspace}
\DeclareMathOperator*{\argmax}{arg\,max}
\DeclareMathOperator*{\argmin}{arg\,min}
\DeclareMathOperator{\Tr}{Tr}
\newcommand{\norm}[1]{\lVert #1\rVert}
\newcommand{\KL}[2]{ \text{KL}\left(\left.\rule{0pt}{10pt} #1 \; \right\| \; #2 \right) }
\newcommand{\slashfrac}[2]{\left.#1\middle/#2\right.}
\)
A probability space is a mathematical construct that represents a random experiment or system in the world. It defines the possible outcomes, the possible collections of outcomes (events), and the probability that each of those collections of outcomes happen. Therefore, it is like an enumeration of everything that could happen, together with how feasible it is to happen.
Formally, a probability space is a tuple \(\; (\Omega, \mathcal{F}, P) \;\) such that:
-
The sample space \(\; \Omega \;\) is the set of all possible outcomes.
-
The sigma algebra or \(\; \sigma\)-algebra \(\; \mathcal{F} \;\) is set of all possible events, i.e. set of outcomes that are grouped together.
-
The measure \(\; P \;\) is the probability that each of the combinations in the \(\; \sigma\)-algebra happen (formally a measure).
NOTE that sample space, measurable space and probability space are increasingly larger constructs:
Sample space < Measurable space < Probability space.